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The Rosenzweig Picture-Frustration Study 
(P-F) is widely used as a clinical. and re- 
search measure of verbal aggression, although 
its validity has not been clearly established. 
Most validating studies have attempted to 
correlate a specific criterion of aggression 
with the P-F scoring term “extrapunitiveness” 
(E)—defined as the percentage of responses 
in which the individual turns his aggression 
outward, against the environment. For exam- 
ple, Fry (1949), Holzberg and Hahn (1952), 
Vane (1954), and Weinberg (1952) have all 
found that juvenile delinquents or adult 
criminal offenders fail to manifest more E on 
the P-F than nonantisocial subjects (Ss), and 
have therefore concluded that the P-F is not 
valid. That such studies may represent too 
narrow an approach to validation is indicated 
by the APA Committee on Test Standards 
(1954, pp. 14-15) who note that test validity 
in the case of most clinical instruments must be 
evaluated by integrating evidence from many 
different sources and that often no single cri- 
terion measure or composite criterion can be 
identified. Thus aggression may occur in 
many different degrees, in many different 
situations, and in many different forms. Con- 
versely, similar degrees of aggression could be 
expressed in different ways. It therefore may 
not be reasonable to expect that any particu- 
lar measure of aggression which is arbitrarily 
selected as the single and specific criterion 


2A version of this paper was presented at the 
Eastern Psychological Association Meeting at Phila- 
delphia, April 12, 1958. 

This study was carried out as part of a research 
project on nonconformist behavior conducted within 
the Department of Psychiatry, Yale University, di- 
rected by Lawrence Z. Freedman, and supported by 
the State of Connecticut and Foundations Fund for 
Research in Psychiatry. The orientation of the paper 
does not necessarily reflect the theoretical frame- 
work of the over-all study. 
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out of the total spectrum of aggressive be- 
havior should relate to P-F performance. 

This paper represents an attempt to in- 
vestigate the validity of the P-F by relating 
the quantity and intensity of aggressive re- 
sponses obtained on it to aggression as de- 
scribed by various other techniques. We as- 
sume that if the P-F does refer to aggression 
it should relate to a substantial proportion 
of the other measures of aggression. 

A measure of the intensity of aggressive re- 
action to frustration was designed in the be- 
lief that mild verbal aggression, such as “I 
don’t agree,” might characterize a different 
reactive process to frustration than that re- 
flected by responses containing references to 
violent, uncontrolled aggression, such as “T’ll 
break your neck.” The failure of the present 
P-F scoring system to take into account such 
variations in intensity has been pointed out 
by Holzberg and Hahn (1952). This addi- 
tional measure is expected to broaden the 
range of relationships between the P-F and 
other measures of aggression. 

The investigation utilizes part of the data 
collected in an interdisciplinary study of anti- 
social offenders classified as sexual, aggres- 
sive, or acquisitive. Psychiatrists, psycholo- 
gists, sociologists, and to a limited degree, 
lawyers, cooperated in obtaining data by the 
techniques appropriate to each discipline in 
such a way as to allow comparable statistics 
and other analyses. A great deal of informa- 
tion was thus compiled for each individual, 
providing possibilities for describing and re- 
lating behavior in a variety of contexts. 


PROCEDURE 
Subjects 
The sample tested consisted of 121 male state 


prison inmates selected so as to match the total 
prison population on eleven variables, including age, 
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education, and marital status. In terms of general 
characteristics the sample may be described as fol- 
lows: 41 sexual offenders, 40 aggressive offenders, 40 
acquisitive offenders; 72% white, 28% Negro; me- 
dian age 36.4 years; 55% did not have any educa- 
tion beyond the 8th grade, 41% had some high 
school, 4% some college; median IQ was 96.2; me- 
dian time in prison to date of testing was 2.2 years. 

Ss were assured that participation or nonpartici- 
pation could have no possible effect on their prison 
status, Cooperation was voluntary. Approximately 
20% of those called refused psychological testing. 
On the basis of the freedom of expression observed 
during interviews there is reason to believe that 
most Ss accepted the fact that the study had no 
connection with the prison authorities and Ss were 
not usually on “best behavior.” 


Picture-Frustration Study 


The P-F was administered individually or in 
groups of no more than five Ss so that the testing 
performance could be readily observed. All the P-F 
protocols were scored according to Rosenzweig’s Re- 
vised Scoring Manual (Rosenzweig, 1950) and with- 
out knowledge of the S’s identity of his performance 
on other measures. The final scores yielded the per- 
centage of responses falling within each type and 
direction of aggression provided for by the scoring 
system. Two scorers obtained 81% agreement on the 
exact scoring of responses, 

In addition to analyzing protocols in terms of the 
usual P-F scoring system, responses scored as extra- 
punitive were rated along a scale designed to reflect 
the intensity of aggressive reaction to frustration 
(IE). Each response was assigned a rating according 
to the following three-point scale: 


1. Mild IE: Responses which contain bland, in- 
direct aggression within the limits of socially ac- 
ceptable behavior, such as “I don’t think so,” or 
“T wish she would remove her hat.” 

2, Moderate IE; Responses which indicate sar- 
casm, strong displeasure, direct blame, or insist- 
ence that the other person do something about the 
situation, such as “How about next year,” in re- 
sponse to an apology for breaking an appoint- 
ment. 

3. Extreme IE; Responses which contain direct, 
overt verbal aggression so that social prohibitions 
are weakened, as in violent expressions of emotion 
directed toward the frustrating person or situa- 
tion. Swearing and other abusive language, includ- 
ing threats of physical harm such as, “I’ll knock 
your head off,’ frequently occurred in such re- 
sponses. 


The IE scores referred to in the analysis of the 
data are median scores. The percentage of agree- 
ment on the exact rating of individual responses for 
two scorers was 83.8% and the coefficient of reli- 
ability (Pearson r) for the median scores was .86. 
Intropunitive responses were also rated along an in- 
tensity scale but the restricted range of expression 
precluded the development of a measure which could 
be utilized for further statistical analysis. 
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Aggression Measures * 


In keeping with the conception of aggression as a 
heterogeneous pattern of behavior it seemed neces- 
sary to select measures designed to tap aggressive 
content in as broad a range of behavior as possible. 
Accordingly the P-F measures were related to data 
pertinent to aggressive behavior derived from the 
Rorschach, a psychiatric schedule, a specially de- 
vised Attitude Scale, and the prison record. The P-F 
was chosen because it seemed appropriate to evalu- 
ate the individual’s manner of handling mild verbal 
frustration and provided a standardized system for 
the evaluation of aggressive responses to such situa- 
tions. The psychiatric interview was intended largely 
as an exploration in the individual’s personal history, 
including various aspects of his aggressive behavior 
as he saw it. The Attitude Scale was designed to 
permit the individual to express his attitudes about 
family members and his own feelings without such 
responses being filtered through an interpreter, such 
as an interviewer. The Rorschach was selected as an 
instrument presumed to minimize conscious control 
over the meaning of responses which might reflect 
aggressive feelings the S would not or could not ex- 
press in response to the other techniques. The prison 
record provided some indication for the degree of 
antisocial behavior. 


Rorschach 


All Rorschachs were scored according to Klopfer’s 
method, except for form level, where Beck’s criteria 
were used. Records were evaluated with the help of 
a manual devised to analyze the following dimen- 
sions: degree and control of aggression, passive de- 
pendency, degree and control of sexual disturbance, 
degree of thought disturbance, principal defenses 
used, and diagnostic classification. Degree was rated 
from little (1) to extreme (3); control from good 
(1) to very poor (4). Signs for each dimension con- 
tained in the manual were obtained from the text- 
books of Klopfer (1954), Phillips and Smith (1953), 
Rapaport (1945) and Schafer (1954), where two 
or more books agreed on their interpretation, as well 
as Elizur’s (1949) hostility signs. The following ex- 
cerpt of the description of the procedure given to 
the raters will illustrate the way in which these 
signs were used: 


Very high frequencies of signs on a particular 
variable (e.g., aggression) will almost always indi- 
cate serious problems in that area, but a similar 
degree of concern may also be reflected in one or 
very few responses of extreme intensity. Thus 
many aggressive symbols such as knives and spears, 
or one response, in an otherwise bland record, of 
torn flesh and a lot of spattered blood, might both 
indicate a high degree of aggressivity. ... Such 
evaluation requires much clinical experience, and 
the latter will be the principal tool of evaluation 
of the Rorschachs in this study. 


2A more detailed description of these measures, 
including scoring criteria, may be obtained from the 
senior author. 
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It is recognized that this approach is quite subjec- 
tive but the authors are not aware of any other 
method which can successfully deal with the Ror- 
schach as a clinical instrument designed to tap 
largely unconscious feelings. 

Space does not permit the listing of the signs used 
as indicators of all the dimensions, but the signs 
used in the evaluation of degree of aggressivity may 
serve as an example: Frequency of Elizur’s (1949) 
hostility signs; blood; splattered fluids (e.g., paint) ; 
high visceral anatomy; fire; high FM with low M 
(example: rate “3” if more than 20% FM with no 
or one M where content aggression is moderate) ; 
very critical of cards; rejects (Card IX reject least 
important). As a reliability check, Rorschachs were 
rated according to the above method by another 
judge. Exact agreement varied from 40% to 75% 
on three-point scales, as poor and very poor con- 
trol ratings were combined in order to roughly equal- 
ize Ns in all categories. Percentage agreements for 
the variables here reported are shown in Table 2. 
Two-step disagreements constitute 9.8% of all com- 
parisons, Chi square significance at the .01 level for 
over-all comparisons and those reported here sug- 
gests better than chance agreement, but the per- 
centages do not give much confidence for predictive 
purposes. The Rorschach ratings are nevertheless re- 
ported here because it was found that, with very 
few exceptions, Rorschach ratings made by the au- 
thor correlated in the expected direction with other 
variables in the study (not reported here) so that 
there is some basis for believing that the criteria 
used are relevant to the categories of behavior ex- 
amined. It is true that the Rorschach data does not 
add or detract much from the value of this report, 
but it seemed proper to report all the data pertinent 
to the variables under discussion. 


Attitude Scale 


Adopted from a procedure suggested by Toman 
(1955), a 205-item Thurstone-type scale was de- 
vised which required agreement or disagreement with 
statements expressing attitudes toward important ob- 
jects and persons, The statements given to Ss were 
arranged in a random sequence and Ss were required 
to circle “Yes” or “No” for each statement. The 
scale was analyzed in terms of 45 five-item continua, 
ranging from maximum approval (Statement 1) to 
maximum disapproval (Statement 5) of a person or 
attitude. The following continuum of attitudes to- 
ward the father, for which data are reported in 
Table 2, will serve as an illustration of the instru- 
ment: 


1, I loved my father best of all. 

2. I liked my father. 

3. I often liked my father, but sometimes I got a 
little fed up with him. 

4. I often can’t help having a feeling of dislike 
for my father, 

5. It should be different, but I can’t help hating 
my father. 


8 Jacob Goldstein, New School for Social Research, 
New York City. 
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Agreement with Statements 1 or 2 or 1 and 2 or 
1 and 3; or 2 and 3 or 1, 2, and 3 were scored as 
positive. Corresponding combinations of agreement 
to Statements 3, 4, and 5 were scored as negative. 
Any combination of agreements with statements on 
both sides of Statement 3 was scored as ambivalent, 
as was also agreement with Statement 3 alone. Nine- 
teen percent of all responses were ambivalent. Re- 
sponse reliability was checked by a three-item lie 
scale (e.g., I have never had a headache) and by the 
repetition of three statements. Seventy-six percent 
of Ss disagreed with all three lie statements and 
12% gave different responses on repeated statements, 

Scale reliability was checked by independent sort- 
ing of all items by a naive rater into graded groups 
of five statements. The rater differed from a priori 
scaling in 3.6% of cases. 


Psychiatric Schedule 


The psychiatrist followed a prepared schedule 
which required that specific information be recorded 
in such a way as to be easily codable. All but 20 of 
the psychiatric interviews were conducted by one 
psychiatrist.4 All information was recorded during 
the interview. Coding criteria were specific enough 
to permit coding by clerical personnel. As a reli- 
ability check 1,000 randomly selected items, chosen 
from all psychiatric schedules, were recorded by an 
inexperienced coder. She achieved 83% exact agree- 
ment with the previous coder. 

The following illustrates the criteria used in cod- 
ing answers to questions about the frequency of 
aggressive behavior between S and the younger male 
sibling (see Table 2 for data). 


O—no fights 

1—infrequent fights, less than 10 instances in all 

2—sometimes, but not more than once in three 
months 

3—more frequently than above but not as much 
as once per week on the average 

4—once per week or more, but less than once a 
day 

5—once per day or more 

X—no such individual 

Y—no answer 


Questions were not asked in a set way but the in- 
terviewer attempted to start each area of inquiry 
with a general question, such as, “How about your 
younger brother?” and then would ask more spe- 
cific questions when necessary. 


Prison Record 


The last three items in Table 2 were taken from 
the prison record. History of serious antisocial ag- 
gression referred to previous felony convictions (as- 
sault). Present offense classification and the activity 
for which convicted (e.g., murder) were judged from 
a police description of the behavior during the 
offense. Thus the inactive accomplice to murder was 


4 Hugh Storrow, now in the Department of Psy- 
chiatry, University of California, Los Angeles. 
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not classified cither “aggressive” or “murderer” even 
though he may have been convicted for murder. 

Twenty-two variables comprising all the data 
bearing on aggressive behavior of sufficient numeri- 
cal range for statistical analysis were abstracted from 
these techniques and related to P-F performance by 
chi square (see Table 2). The distributions of E and 
IE scores were split into high, moderate, and low 
groups. Statistical requirements of chi square (Coch- 
ran, 1954) necessitated the collapsing of some con- 
tingency tables and in all such cases the upper ex- 
tremes (high scores) were contrasted with the com- 
bined moderate and low scores. 


RESULTS 


Table 1 indicates that the mean extrapuni- 
tive, intropunitive, and impunitive scores for 
our sample closely matched the revised norms 
reported by Rosenzweig (1950). The scores 
for our sample, however, appear to be some- 
what more variable on all three measures 
than those obtained from his normative sam- 
ple. The mean for the intensity rating of 
extrapunitiveness was 1.29 with a standard 
deviation of .32 for a three-point scale, indi- 
cating that most Ss tend to express a rather 
mild intensity of aggression to this technique 
as measured by our ratings. 

The interrelationships of P-F measures were 
determined by correlational and chi square 
analyses and are reported in Table 2. E was 
found to be significantly correlated with the 
IE measure, so that frequency and intensity 
of aggression appear positively associated. E 
was inversely related to intropunitiveness and 
impunitiveness as a result of the dependent 
scoring system. However, the association of 
both high E and high IE with both high ego 
defensiveness and low need peristence scores 
represents a relationship between independ- 
ent scoring categories. The latter measures 
are two of Rosenzweig’s three “types of Ag- 
gressive Reaction.” According to Rosenzweig, 
Ss who express intense and/or frequent out- 
ward aggression on the P-F tended to respond 
in a manner “in which the ego of the subject 
predominated” rather than in a manner in 
which “the solution of the frustrating prob- 
lem is emphasized” (Rosenzweig, Fleming, & 
Clarke, 1947, p. 166). 

Twenty-three out of an over-all total of 
73 relationships tested by chi square were 
significant at the .05 level or beyond, while 
12 more approached significance at the .10 
level. In relating E and IE to measures of 
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TABLE 1 


Means AND STANDARD DeEviaTIONS FOR PICTURE 
FRUSTRATION STUDY VARIABLES 


(Rosenzweig’s Norms in Parenthesis) 











Mean Standard Deviation 
Extrapunitiveness 47,49 (45) 15.71 (13.3) 
Intropunitiveness 26.40 (28) 10.01 ( 8.3) 
Impunitiveness 26.26 (27) 9.73 ( 9.5) 
Intensity of 
Extrapunitiveness 1.29 315 





aggression elicited by other techniques, 12 of 
22 relationships for E and 8 of 22 for IE 
were found to reach the .10 level or beyond. 
The total number of significant findings is 
thus well beyond the number expected on the 
basis of chance alone. 

Chi squares significant at the .05 level or 
beyond revealed that E was associated with 
the S’s report of aggression and negative feel- 
ings in object relationships, as with fathers 
and wives; the perception of peers as hostile 
and threatening; a history of antisocial ag- 
gression; and murder in the present offense. 
Moreover, the data reflect a number of trends 
which fall between the .05 and the .10 level. 
High E tends to be associated with the psy- 
chiatrist’s rating of high verbal aggressiveness 
and, as judged from the Rorschach, poor con- 
trol of aggression, the use of projection as 
a defense mechanism, and the diagnosis of 
schizophrenia. The only findings which seem 
inconsistent with the general direction of re- 
sults was a trend for high E Ss to report in- 
frequent fighting with peers. 

The IE measure was found to correlate .48 
with E—a moderate but statistically signifi- 
cant degree of correlation. It is not surprising, 
therefore, that IE related to many of the same 
measures as E. Thus, like high E, high IE 
relates to aggression and negative feelings 
in object relationships, as with siblings and 
wives; to a history of antisocial aggression; 
and to murder in the present offense. In ad- 
dition, high IE was found to be significantly 
associated with poor control of aggressive im- 
pulses and the expression of intense affect on 
the Rorschach. 

Both E and IE were unrelated to the de- 
gree or amount of aggression manifested on 


450 J. Kaswan, M. Wasman, and L. Z. Freedman 


TABLE 2 


THE RELATIONSHIP OF EXTRAPUNITIVENESS (E) AND INTENSITY OF EXTRAPUNITIVENESS 


(IE) To AGGRESSION VARIABLES 








High E Scores are Related to: 


High IE Scores are Related to: 








Variable Description df Chisquare® Significance level’ Chi square* Significance levelb 
P-F Variables 
High extrapunitiveness* 4 25.53 1 
High extrapunitiveness intensity 4 25.53 OL 
Low intropunitiveness 4 65.35 01 12.59 02 
Low impunitiveness 4 31.90 01 10.32 04 
Low object dominance 4 7.80 10 5.48 
High ego defensiveness 4 37.10 01 16.54 01 
Low need persistance 4 24,97 01 10.46 04 
Rorschach 
Degree of aggression (73%)° 2 1.87 1.24 
Inadequate control of aggression (65%) 2 5.17 .07 6.63 04 
High degree of intense affect (62%) 4 271 10.23 05 
Use of projection as a defense (73%) 1 2.89 10 
Diagnosis of schizophrenia (65%) 1 4,46 04 
Attitude Scale 
Reaction to frustration 2 98 1.59 
Reaction to criticism 2 2.04 32 
Perception of peers as hostile 2 6.89 .04 2.85 
Negative feeling toward father 2 14,81 Ot 3.86 
Psychiatric Schedule 
Subject’s rating of self-control over 1 .87 49 
anger 
Psychiatrist’s rating of subject’s ag- 2 58 1.31 
gressiveness 
Tendency to express aggression 1 3.24 08 1.23 
verbally (Psychiatrist’s rating of 
manner in which subject expresses 
aggression) 
Submissive behavior toward father 2 2.92 11.37 Ot 
(developmental) 
Frequent aggressive behavior toward 1 1.35 5.47 .02 
younger male siblings 
Infrequent fighting with peers (de- 1 3.56 07 59 
velopmental) 
Frequent destruction of property 1 3.28 3.47 .07 
(developmental) 
Fighting with peers (current) 1 31 64 
Frequent verbal aggression toward 1 2.78 .10 1.02 
wife 
Frequent physical aggression toward 2 6.97 .03 5.42 .07 
wife 
History of serious anti-social aggression 2 8.40 01 3,184 .08 
Present offense classified as sexual, ag- 4 1.62 4.11 
aggressive, or acquisitive 
Murder in present offense 2 4,68 .10 6.83 04 





® Yates correction in two by two tables. 
» Two-tailed, 


: eet agreement of two raters on three-point scale. 
= 1, 


*y = .48 significant at the .01 level. 
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the Rorschach, S’s report of his reaction to 
frustration and criticism, S’s rating of his 
self-control over anger, interviewer’s rating of 
S’s aggressivity, current fighting with peers 
and present offense classified as sexual, ag- 
gressive, or acquisitive. 

Both amount and intensity of extrapuni- 
tiveness were compared with age, race, re- 
ligion, rural-urban background, social class, 
marital status, education, IQ, and length of 
time in prison. Those Ss with high E tend 
to be older (x? = 9.86, df=2, p= .01), 
widowed or divorced (x? = 3.71, df=1, p= 
.06), and to have an education beyond the 
8th grade (x? = 7.17, df= 2, p= .04). Ss 
with high IE tend to come from an urban 
background (y? = 7.56, df=2, p= .03). 
None of the other comparisons yielded chi 
squares approaching significance. 

The relationships of intropunitiveness and 
impunitiveness to other measures discussed 
above were investigated but results have not 
been presented since they were generally 
found to be the inverse of those relationships 
reported for extrapunitiveness by virtue of 
the reciprocal nature of the scoring system. 


Discussion 


This investigation has provided evidence 
that the P-F relates to a variety of manifesta- 
tions of aggressive behavior as assessed by a 
psychiatric interview, Rorschach evaluation, 
and an attitude scale. The scoring dimension 
of E related to aggression in terms of hostile, 
aggressive interpersonal feelings and behav- 
ior, and antisocial aggression with tendencies 
toward the use of projection and inadequate 
impulse control. The score for IE developed 
in this study and the standard scoring dimen- 
sion of extrapunitiveness (E) show consider- 
able overlap, the former also relating to the 
adequacy of impulse control and intensity of 
affect on the Rorschach. Determination of the 
value of the intensity measure in extending 
the range of the P-F scoring system is a prob- 
lem for further research. 

The results also indicate that higher edu- 
cation and IQ are positively related to high 
E and high IE. An additional analysis of the 
data revealed that IQ and education were not 
significantly correlated with other variables 
bearing on aggression so that no attempt was 
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made to control their effects statistically. One 
could speculate that the P-F technique was 
most suitable for eliciting aggressive responses 
from Ss in our sample who are better able to 
deal with verbal stimuli or to express aggres- 
sion verbally. 

The P-F failed to relate to many aspects 
of aggression, such as type of criminal offense, 
reported behavior in response to frustration 
and criticism, and aggressive behavior toward 
peers. These measures which did not relate to 
the P-F seem no less a reasonable criteria 
than those which had a positive relationship 
to it. The problem of evaluating validity in 
terms of several relationships, some of which 
are significant or nearly significant while 
others are not, may be viewed in at least 
two ways. One is to postulate that items 
which relate positively to the P-F should 
characterize some particular aspect of ag- 
gression (e.g., level). Examination of Table 2 
indicates that for our results such a con- 
ceptualization would, at best, require consid- 
erable and perhaps tenuous speculation, inas- 
much as diverse features of aggressive behav- 
ior relate to extrapunitiveness. This failure to 
find a cluster of conceptually meaningful re- 
lationships may be the fault of the study, but 
we would suggest that expecting such a clus- 
ter may not be reasonable, which brings us 
to the alternative interpretation. 

Suppose, for instance, that there are two 
Ss with the same high E P-F scores for whom 
extensive personality evaluations, presumed 
valid, are available. One of these Ss gener- 
ally expresses his aggression only verbally. 
He is sarcastic, bitter, and superior but never 
attacks anyone directly and has no history of 
overt physical aggressive behavior. For the 
other individual the high E score is but one 
manifestation of generally very aggressive be- 
havior expressed along the entire spectrum of 
this attribute. There would probably be none, 
or a negative relationship between the P-F 
and measures of overt aggression for the first 
S and a positive relationship with almost any 
measure of aggression for the second S. This 
illustrates how the same form and intensity 
of aggression in a particular situation (e.g., 
high E on the P-F test) may reflect different 
types and degrees of aggressivity for different 
individuals. To be sure, aggression shown on 
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one technique, such as the P-F, must be re- 
flected in some other measures of that at- 
tribute if the technique is valid; however, 
which measures will be found to correlate 
would, from this point of view, be a prob- 
lem of sampling. That is, positive correla- 
tions can be expected to the degree to which 
the personality characteristics of different Ss 
overlap in the expression of aggression. Since 
even elaborate matching procedures are un- 
likely to yield identical samples of Ss, differ- 
ent samples can be expected to show different 
interrelationships between a particular meas- 
ure, such as the P-F, and other measures de- 
signed to reflect a range of that attribute 
(e.g., Rorschach, attitude scale, other meas- 
ures of aggression). 

Nevertheless, while two samples would 
rarely yield exactly the same interrelation- 
ships, it is possible that given a large num- 
ber of succesive samples tested with the same 
battery, the test measure (e.g., the P-F) will 
be found to correlate more often with some 
criterion measures than with others. Thus, 
while the pattern of intercorrelations may not 
make too much sense for any particular sam- 
ple (as in the present study), it is possible 
that a conceptually meaningful pattern of 
test-criteria relations may emerge through 
frequency counts of such relations across a 
large number of samples. Such a procedure 
might help to establish the specific construct 
validity of the P-F by indicating which as- 
pects of aggression it reflects more often than 
others. The present study is concerned with 
the much more modest task of investigating 
whether the P-F relates to any aspect of ag- 
gression. For this purpose it would seem a 
reasonable test of validity to require that, 
given a pool of criterion measures (e.g., atti- 
tude scale, Rorschach, etc.), the number of 
positive relations to the measure tested (P-F) 
exceed chance expectations. 


SUMMARY 


Extrapunitiveness in the Picture-Frustra- 
tion Study and an intensity of extrapunitive- 
ness measure developed by the authors were 
related to 22 measures of aggression derived 
from the Rorschach, an attitude scale, a psy- 
chiatric interview schedule, and case history 
data. The Ss in this study were 121 inmates 
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of a state prison selected so as to match the 
entire prison population. Of a total of 44 chi 
square comparisons between the Picture- 
Frustration Study and these measures, 10 
were significant at better than the .05 level 
of confidence, and another 10 between the .05 
and .10 level. These results were interpreted 
as indicating that the P-F has some relation 
to other measures of aggression. The P-F was 
not found to tap any particular level or as- 
pect of aggression, and it was suggested that 
repeated cross-validation would be required 
before possible criteria validity could be es- 
tablished. 
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